2 links tagged with all of: prompt engineering + evaluation
Click any tag below to further narrow down your results
Links
Spotify built Vedder, an AI data assistant that uses domain-specific “clusters” curated by expert teams to provide reliable SQL-generated insights. Each cluster combines relevant datasets, vetted question–SQL pairs, and docs, with automated health scoring and feedback loops to keep context accurate and scalable.
- Auto-generating question-SQL examples from query logs mostly failed—only 12.5% passed expert review, proving curated human examples beat scraped ones
- Vedder's reliability comes from domain-expert-curated "clusters" (tables + vetted SQL examples + docs), not a bigger LLM
- Health scoring tracks schema drift and broken examples so experts know which clusters need fixing as data evolves
- Adopted by 2,100+ employees for 13,000+ conversations since August 2025, showing real traction beyond a pilot
The article explores the parallels between the film "Lord of War" and the current AI compute market, focusing on Jensen Huang of Nvidia as the central figure in the AI arms race. It details an experiment where multiple AI image generation models were tested to recreate a parody poster, "Lord of Tokens," using advanced prompts that challenge the models' capabilities. The results highlight varying levels of success in achieving the desired artistic and technical details.
- The "Lord of Tokens" poster parody frames Jensen Huang as the central arms dealer of the AI compute boom, mirroring Nicolas Cage's character in "Lord of War"
- Multiple leading AI image generation models were torture-tested with a complex, design-agency-grade prompt to recreate this parody poster
- The models showed significantly varying success rates in nailing the specific artistic composition and technical details demanded by the prompt